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1.  Summary  of  Research  in  the  Period  July,  1081  ■■  June  30, 10£;-1 

Broadly  speaking,  the  research  supported  by  the  Air  Force  Office  of 
Scientific  Research  during  this  period  of  nearly  three  years,  has  centered  about 
general  matrix  methods,  and  applications  of  matrix  theory  in  solving  large  sys¬ 
tems  of  linear  equations. 

Listed  beloAV  are  those  research  papers,  appearing  in  print  in  this  period 
(July,  1981  -  June,  1984)  or  pending  publication,  which  were  outgrowths  of  the 
research  supported  by  the  Air  Force  Office  of  Scientific  Research.  (All  carry,  or 
will  carry,  an  acknowledgement  of  AFOSR  support.) 

1.  J.  J.  Buoni  and  R.  S.  Varga,  “Theorems  of  Stein  -  Rosenberg  type.  II. 
Optional  paths  of  relaxation  in  the  complex  plane”.  Elliptic  Problem  Solvers 
(Martin  H.  Schultz,  ed.),  pp.  231  -  240,  Academic  Press,  Inc.,  New  York, 
1981. 

2.  R.  S.  Varga  and  D.-Y.  Cai,  “On  the  LU  factorization  of  M-matrices”, 
Numer.  Math.  38  (1981),  179  -  192. 

3.  J.  J.  Buoni,  M.  Neumann,  and  R.  S.  Varga,  “Theorems  of  Stein  -  Rosenberg 
type.  in.  The  singular  case”.  Linear  Algebra  and  Appl.  42  (1982),  183  -  198. 

4.  R.  S.  Varga  and  D.-Y.  Cai,  “On  the  LU  factorization  of  A/ -matrices:  cardi¬ 
nality  of  the  set  P^{A  )”,  SIAM  J.  Algebraic  Discrete  Methods  3  (1982),  250  - 
259. 

5.  W.  Niethammer  and  R.  S.  Varga,  “The  analysis  of  k-siep  iterative  methods 
for  linear  systems  from  summability  theory”,  Numer.  Math.  41  (1983),  177  - 
206. 


6. 


7. 


8. 


9. 


10. 


11. 


W.  Gautschi  and  R.  S.  Varga,  “Error  bounds  for  Gaussian  quadrature  of 
analytic  functions”,  SIAM  J.  Numer.  Anal.  20  (1983),  1170  -  1186. 

R.  S.  Varga.  W.  Niethammer,  and  D.-Y.  Cai,  “p -cyclic  matrices  and  the 
symmetric  successive  overrelaxation  method”.  Linear  Algebra  and  Appl.  58 
(1984),  425-439. 

W.  Niethammer,  J.  de  Pillis,  and  R.  S.  Varga,  “Block  iterative  methods 
applied  to  sparse  least  squares  problems”.  Linear  Algebra  and  Appl.  ^ 
(1984),  327-341. 

R.  S.  Varga,  “A  survey  of  recent  results  on  iterative  methods  for  solving 
large  sparse  systems  of  linear  equations”.  Elliptic  Problem  Solvers  (G. 
Birkhofff  and  A.  Schoenstadt,  eds.),  pp.  197-217,  Academic  Press,  Inc.,  New 
York,  1984. 

G.  Csordas  and  R.  S.  Varga,  “Comparisons  of  regular  splittings  of  matrices”, 
Numer.  Math.  44  (19841.  23-35. 

A.  Neumaier  and  R.  S.  Varga,  “Exact  convergence  and  divergence  domains 
for  the  symmetric  successive  overrelaxation  (SSOR)  iterative  method  applied 
to  //-matrices”,  Linear  Algebra  and  Appl.  (1984),  261-272.  i aMC) 

a,.  u. 
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The  above  research  papers  can  be  roughly  grouped  into  the  following  areas: 

A.  Factorization  of  A/-matrics. 

B.  Extensions  of  the  Stein  -  Rosenberg  Theorem. 

C.  The  use  of  summability  methods  and  approximate  conformal  mappings  tech¬ 
niques  in  the  study  of  iterative  methods. 

D.  A  study  of  the  SOR  (successive  overrelaxation)  and  the  SSOR  (symmetric 
successive  overrelaxation)  iterative  methods,  using  the  theory  of  //-matrices. 

E.  Comparisons  of  regular  splittings  of  matrices. 

We  give  below  a  brief  discussion  of  our  research  results,  according  to  the 
topics  listed  above. 

A.  Factorization  of  matrices. 

An  n  Xn  A/ -matrix  A  =  [a,,yl  is  said  to  admit  LU  factorization  into 
n  Xn  A/ -matrices  if  A  can  be  expressed  as 

A  =  L  ■  U  ,  (a.l) 

where  L  =  [/,■  y]  is  an  n  Xn  lower  triangular  A/-matrix  (i.e., 

h,j  ,/,•  y  <0  for  all  I  >y  ,  and  /,-,y=0  for  all  j  >» ;  l<a ,  j  <n  ), 

and  where  U  =[«,^y]  is  an  n  Xn  upper  triangular  A/ -matrix  (i.e., 

,  Ui  j  <0  for  all  j  >t  and  a,-  y  =0  for  all  i>  j:  1<» ,  j  <n  )  . 

A  well-known  result  from  1962  of  Fiedler  and  PtAk  [A.l]  gives  that  any  non¬ 
singular  A/-matrix  admits  such  an  LU  factorization  in  (a.l)  with  L  nonsingu¬ 
lar,  while  in  1977,  Kuo  [A.3]  later  showed  that  any  n  Xn  irreducible  A/-matrix 
(singular  or  not)  admits  such  an  LU  factorization  with,  say,  L  nonsingular,  as  in 
(a.l).  More  recently,  in  1981,  Funderlic  and  Plemmons  [A.2]  have  shown  that  if 
annXn  M -matrix  A  satisfies 

A  >  0^  for  some  jr  >  0  ,  (a.2) 

then  A  admits  an  LU  factorization  into  A/-matrices,  as  in  (a.l),  with  L  non¬ 
singular. 

What  was  left  open  in  the  literature  was  an  analogous  discussion  of  the  LU 
factorization  of  reducible  and  singular  A/-matrices.  This  was  completely  settled 
by  Varga  and  Cai  [A. 4],  using  graph  theory.  That  result  is 

Theorem  1.  ([A.4]).  Let  A  beannXn  A/ -matrix.  Then,  the  follow¬ 
ing  are  equivalent: 

t )  A  admits  an  LU  factorization  into  A/ -matrices  with  nonsingular  L  ; 

«)  for  every  proper  subset  of  a  =  {Q’i,02>  ■>“* }  of  {1)2,  •,«  }  for  which 
the  matrix  A  [a]  is  singular  and  irreducible,  there  is  no  path  in  the 
directed  graph  G^[A  )  of  A  from  vertex  to  vertex  v^y  ,  for  any 

t  >  Qif  and  any  I  <  j  <  k  . 


It  turns  out  that  Theorem  1  also  gives  the  previous  results  of  Fiedler  and 
Ptak  [A.1]  and  Kuo  [A.3]  as  special  cases. 

Next,  the  condition  (a.2)  of  Funderlic  and  Plemmons  [A.2]  implies  that 

2^(PAP^)  >  0^  ,  where  ^  :=  Px  >  0  ,  (a.3) 

for  every  n  X  n  permutation  matrix.  In  other  words,  the  result  of  Funderlic  and 
Plemmons  (A.2]  gives  that  condition  (a.2)  is  a  sufficient  condition  that  PAP  ^ 
admits  an  LU  factorization  into  Af -matrices  with  nonsingular  L ,  for  every 
n  X  n  permutation  matrix  P .  It  turns  out  that  condition  (a.2)  is  a  necessary 
condition  for  this  as  well,  and  this  is  given  Theorem  3  of  Varga  and  Cai  [A.4]. 

Finally,  there  are  easy  examples  of  nXn  A/ -matrices  A  which  do  not 
satisfy  (a.3)  for  every  nXn  permutation  matrix  P.  With  A  an  nXn  M- 
matrix,  and  with 

P  ®(A  )  :=  {n  Xn  perm,  matrices  P  :  PAP  ^admits  an  (a.4) 

LU  factorization  with  nonsingular  L.  }  , 

there  then  exists  n  Xn  M -matrices  A  for  which  P  ^(A)  does  not  contain  all 
n  Xn  permutation  matrices.  In  Varga  and  Cai  [A.5},  a  reduction  algorithm 
(based  on  the  reduced  canonical  form  of  the  matrix  A)  is  given  which  either  gives 
the  exact  number  of  elements  in  P  or  gives  nontrivial  upper  and  lower  esti¬ 
mates  for  the  exact  number  of  elements  in  P  ^  . 

References 

A.l.  M.  Fiedler  and  V.  Ptak,  “On  matrices  with  nonpositive  off-diagonal  elements 
and  positive  principal  minors”,  Czech.  Math.  J.  12  (1962),  382  -  400. 

A.2.  R.  E.  Funderlic  and  R.  J.  Plemmons,  "LU  decompositions  of  A/-matrices  by 
elementation  without  pivoting”.  Linear  Algebra  and  Appl.  41  (1981),_.99  - 
110. 

A.3. 1-wen  Kuo,  “A  note  on  factorization  of  singular  M -matrices”,  Knear  Algebra 
and  Appl.  16  (1977),  217  -  220. 

A.4.  R.  S.  Varga  and  D.-Y.  Cai,  “On  the  LU  factorization  of  Af -matrices”, 
Numer.  Math.  38  (1981),  179  -  192. 

A.5.  R.  S.  Varga  and  D.-Y.  Cai,  “On  the  LU  factorization  of  A/-matrices:  cardi¬ 
nality  of  the  set  Pn*(A  )”,  SIAM  J.  Alg.  Disc.  Meth.  3  (1982),  250  -  259. 
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B.  Extensions  of  the  Stein  -  Rosenberg  Theorem. 

To  iteratively  solve  the  matrix  equation  A£  =  ^,  where  ^  is  a  given  n  X n 
complex  matrix,  it  is  convenient  to  express  the  matrix  A  as  the  sum 

A  =  D  -  L  -U  (b.l) 

where  D ,  L ,  and  U  are  n  X  n  matrices  with  D  assumed  nonsingular,  and  to 
form  the  iteration  matrices 

L^  :=  {D  -  <jj  L  )"^  I  (l-o;)  D  +  u  U  |  ,  and  :=/  -  oj  D"*  A  .  (b.2) 

Here,  is  the  familiar  successive  overrelaxation  (SOR)  iteration  matrix,  while 
is  the  extrapolated  Jacobi  matrix.  (The  parameter  uj  is  the  relaxation  factor.) 
Now,  the  classical  Stein  -  Rosenberg  Theorem  [B.4]  can  be  seen  to  give,  in  the 
case  that  J  \  >  O  and  that  D~^L  and  D~^U  are  resp.  strictly  lower  and 
strictly  upper  triangular  matrices,  the  following  comparison  of  the  spectral 
radii  of  these  iteration  matrices: 

J  P{L  t,.)  <  p(Ja;)  <  1 .  for  all  0  <  w  <  1  if  p(J  j)  <  1, 

1  P{LJ  >  p(Jw)  >  1 ,  for  all  0  <  a;  <  1  if  piJ^)  >  1  . 

Thus,  on  setting 

Ql  I  we®:  p(L  (^)  <  1  I  ;  D  £,  :=  |  w  e  C :  p(L  w)  >  1  |  > 
and 

{fiy  :=  I  we  C:  p{JJ  <  1  }  :  Z?j  :=  {  we  C:  p(J  J  >  1  }  , 

a  consequence  of  the  Stein  -  Rosenberg  Theorem  can  be  stated  as  the 

Theorem  ([B.4]).  Assuming  J]  >  O  and  that  D  is  nonsingular  in  (b.l) 
with  D~^L  and  DU  respectively  strictly  lower  and  strictly  upper  tri¬ 
angular  matrices,  then 


n  Hj  D  (0,1|  if  p(J,)  <  1  , 

(b.5) 

DlD  DlD  (0,1]  if  ,o(  J,)  >  1  . 

(b.5') 

(b.3) 

(b.4) 

(b.4 


It  was  this  simultaneous  convergence  i.e.,  n  the  SOR 

and  the  extrapolated  Jacobi  iterative  methods  in  (b.5)  which  was  of  interest. 
One  question  then  is  whether  this  simultaneous  convergence  of  these  two  iterative 
methods  is  valid  without  the  assumption  that  J\>  O  and  that  D~^L  and 
D~^U  are  triangular.  Another  question  is  whether  this  could  be  geometrically 
characterized.  These  questions  were  affirmatively  answered  in  Buoni  and  Varga 
(B.11. 


Theorem  ([B.l]).  For  the  splitting  of  (b.l),  assume  only  that  D  b 
nonsinguiar.  Then, 

n  fij  7^  0 

iff  the  point  ^  =  0  is  not  contained  in  K  {D~^A  ),  the  closed  convex  hull 
of  the  eigenvalues  of  D~^A  . 

Continuing  these  investigations 

of  generalizations  of  the  Stein  -  Rosenberg  Theorem,  suppose  that  we  have  the 
simultaneous  convergence  of  the  SOR  and  J iterative  methods,  i.  e.  , 
O  ^K{D~^A)  from  the  previous  theorem.  This  implies  that  if  we  consider  all 
relaxation  factors  uj  on  the  circle  |  w  |  =  r,  for  r  >0  sufficiently  small,  we  can 

attempt  to  find  a  unique  9(r)  such  that  a>  =  minimizes  the  spectral 

radius  on  the  circle,  and,  on  joining  these  points  we  can  speak  of 

an  optimal  path  of  relaxation,  in  the  complex  plane,  for  One  of  the  main 
consequences  of  Buoni  and  Varga  [B.2]  is  the 

Theorem  ([B.2]).  For  the  splitting  of  (b.l),  assume  that  D  is  non¬ 
singular  and  that  O  $  K  (D  ~^A )  .  Then,  for  each  r  >  0  sufficiently 

small,  there  is  a  unique  real  0(r )  such  that 

Moreover,  if  re  ’  is  the  closest  point  of  K  (D  ~^A  )  to  the  origin,  then 

lim  0(r )  =  . 

r  -►  0 

Thus,  an  optimal  path  of  relaxation  exists  for  and  is  tangential  to  the  ray 
re”’*  ,  at  the  origin.  Finally,  an  optimal  path  of  relaxation  for  similarly 
exists,  and  is  tangential  to  the  optimal  path  for  ,  at  the  origin. 

Cases  of  interest  arise  where  an  iteration  matrix  B  is  semiconvergent,  i.e., 

lim  B*  exists  .  (b.6) 

k  —  oo 

In  analogy  with  (b.4),  we  similarly  set  (cf.  (b.2)) 

Sj  :=  jeue  <D  is  semiconvergent  |  ;  (b.7) 

Si  :=  |cu  €  B  is  semiconvergent  |  . 


For  additional  notation,  let  N  (B)  :=  [z  ^  •’ =Q 


denote  the  null 


space  of  an  n  X  n  matrix  B ,  and  set 

index  (5)  :=  min  :  Ar  =  0,1,2,  •,  and  N  {B  '’)  =  N  (B  |  ,  (b.8) 

where  B  ^  :=  I  .  Then,  the  analogue  of  the  Theorem  [B.l]  in  the  singular  case  is 
given  by  Buoni,  Neumann,  and  Varga  [B.3]: 

Theorem  ([B.3]).  For  the  splitting  of  (b.l),  assume  that  D  is  non¬ 
singular,  and  that  all  eigenvalues  of  D~^A  are  not  zero.  Then, 

(  •?/  n  )  \  {  0  I  7»^  0 

i£f  the  point  2  =  0  is  not  contained  in  the  closed  convex  hull  of  the 
nonzero  eigenvalues  of  D~^A  ,  and  index  (D~^A  )  <  1  . 

References 

B.l.  J.  J.  Buoni  and  R.  S.  Varga,  “Theorems  of  Stein  -  Rosenberg  type”.  Numeri¬ 
cal  Mathematics  (R.  Ansorge,  K.  Glashoff,  B.  Werner,  eds.),  pp.  65  -  7^  Bir- 
khauser  Verlag,  Basel,  1979. 

B.2.  J.  J.  Buoni  and  R.  S.  Varga,  “Theorems  of  Stein  -  Rosenberg  type.  II. 
Optimal  paths  of  relaxation  in  the  complex  plane”.  Elliptic  Problem  Solvers 
(M.  H.  Schultz,  ed.),  pp.  231  -  240,  Academic  Press,  Inc.,  New  York,  1981. 

B.3.  J.  J.  Buoni,  M.  Neumann,  and  R.  S.  Varga,  “Theorems  of  Stein  -  Rosenberg 
type.  in.  The  singular  case”.  Linear  Algebra  and  Appl.  42  (1982),  pp.  183  - 
198. 

B.4.  P.  Stein  and  R.  Rosenberg,  “On  the  solution  of  linear  simultaneous  equations 
by  iteration”,  J.  London  Math.  Soc.  23  (1948),  111  -  118. 
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C.  The  use  of  summability  methods  and  approximate  conformal  map¬ 
ping  techniques  in  the  study  of  iterative  methods. 

It  is  well-kno’.vn  in  the  theory  of  iterative  methods  that  ideas  coming  from 
summability  theory  can  be  applied  to  accelerate  standard  iterative  methods.  A 
good  example  of  this  is  the  concept  of  semi- iterative  methods  (which  was 
introduced  by  the  author  in  [C.2]).  It  is  also  well-known  that  the  optimization  of 
parameters  in  an  iterative  method  can  often  be  achieved  by  means  of  conformal 
mapping  techniques.  A  good  example  of  this  is  the  optimal  determination  of 
the  relaxation  factor  w  for  the  successive  overrelaxation  (SOR )  iteration  method, 
in  the  two-cyclic  consistently  ordered  case,  as  first  treated  in  the  famous  work  in 
1954  of  D.  M.  Young  [C. 3].  There,  one  has  the  relation 

(X  -I-  w  -  1)^  =  X 

betwen  the  eigenvalues  X  of  the  SOR  iteration  matrix  L  ^  and  the  eigenvalues  p 
of  the  associated  Jacobi  matrix  J  .  The  classic  result  of  Young  is  that  the 
optimum  value  of  uj,  Wj  ,  is  given  by 

= - /  -  ■  -  (c-1) 

H-\/l  -  (J) 

(where  p{J)  denotes  the  spectral  radius  of  J  ),  when  the  eigenvalues  of  J  ^  are 
nonnegative.  This  result  was  derived  using  known  conformal  properties  of  the 
Joukowski  mapping. 

Deeper  theoretical  results  from  summability  theory  were  apparently  only 
recently  used  in  the  research  of  Niethammer  and  Varga  [C.l],  where  conformal 
mapping  techniques  were  also  brought  into  play.  To  briefly  describe  the  results 
of  [C.l],  suppose  that  we  are  given  an  n  Xn  matrix  equation  A  x  =  b,  which  is 
reduced  to  the  form 

X  =  T  Z  +  £.  ,  (c.2) 

where  the  n  Xn  matrix  T  and  the  vector  c  are  known,  and  where  x  is  the 
sought  vector  solution.  Now,  a  Ar-step  stationary  iterative  method  based  on  (c.2) 
is 

J/m  :=  +  C  )  +  fli  Vm-l  +  •"  +  l^k  Vm-k  ,"»=*.  ^+1,  -  ,  (c.3) 

where  ffi,  ••,  Vk-i  are  given  starting  vectors,  and  where  (Iq,  pj,  •••,  Pjt  are  fixed 
complex  numbers  (independent  of  m  )  which  are  assumed  to  satisfy 

+  +  ■’■  +  t^k  =  1  ■  (c-4) 

The  object,  of  course,  is  the  goal  of  understanding  the  theory  for  selecting  the 
parameters  {py  }y=o  >  so  as  to  make  the  associated  error  vectors 

Em'=ym-2  ,m=k,k+l,  -,  (c.5) 

tend  to  zero  as  rapidly  as  possible  when  m  — ►  (»  . 
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The  point  of  view  taken  in  [C.l]  is  the  following.  Given  some  parameters 
{Hlf  }k^Q  satisfying  (c.4),  what  are  the  geometrical  conclusions,  on  the  spectrum 

of  eigenvalues  of  the  matrix  T  of  (c.2),  so  that  the  error  vectors  of 

(c.5)  decrease  in  norm  as  ,  as  m  -+00,  where  0  <  K  <  1  ?  The  technique 

considered  in  [C.l)  is  to  use  the  general  Euler  method,  from  summability 

00 

theory,  to  transform  the  not  necessarily  convergent  Neumann  series^  5^  T  ^  for 

"y  -=  0 

00 

(/  -  T)~^  to  a  polynomial  series  ('H  improved  convergence  proper- 

y=o 

ties,  where  each  Vj  ( T)  is  a  polynomial  in  the  matrix  T  ,  of  degree  at  most  j  . 

The  convergence  factor  K  where  A'’”  measures  the  norm  of  £„, )  is  then  deter¬ 
mined  by  conformal  mapping  techniques  for  k  -step  stationary  iterative  methods. 

The  detailed  theoretical  results  of  [C.l],  along  with  the  necessary  notations, 
are  too  lengthy  to  be  easily  and  briefly  described  here.  However,  we  note  that 
Section  9  of  [C.l]  is  devoted  to  the  study  of  five  examples  which  connect  with 
well-known  results  in  the  theory  of  iterative  methods. 
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D.  A  study  of  the  SOR  (successive  overrelaxation)  and  the  SSOR  (sym¬ 
metric  successive  overrelaxation)  iterative  methods,  using  the  theory  of 
//-matrices. 

To  describe  our  recent  research  results  in  this  area,  we  first  discuss  the 
results  of  Varga,  Niethammer,  and  Cai  (D.7].  In  the  iterative  solution  of  the 
matrix  equation 

A  z  =k  ,  (d.l) 

assume  that  the  n  Xn  matrix  A  is  in  the  partitioned  form 


where  each  diagonal  submatrix  A,- y  is  square  and  nonsingular  (1  <  «  <  p , 
where  p  >2).  With  D  :=  diag  [A  |  j;  ^2,2!  ■) -^p.p  ).  the  associated  block 
Jacobi  matrix  B  :=  I  -  D  A  has  the  (weakly  cyclic  of  index  p  )  form: 

0  0-0  0 

0  0  ^2,3  •••  0  0 

B  =  .  ...  (d.3) 

0  0  0  •••  0 

1  0  0  •••  0  0 

On  writing  B  =  L  +  U  (where  L  and  U  are  respectively  strictly  lower  and 
strictly  upper  triangular  matrices),  the  associated  SSOR  iteration  matrix  S^  is 
defined  as  usual  by 

:=  (/  -  ujU)-^  [(1  -  w)/  +  ]  (/  -  wL)-*  [(1  -w)/  -|-  uU  ]  ,(d.4) 

where  oj  is  the  relaxation  parameter.  Then,  the  new  result  of  [D.7]  is  the 


functional  equation 


^  r  -  (1  -  6.;)^  j  =7  r  +1  -  a;  j  ^  ^  {2  -  uf  ojf'  (t^  ,  (d.5) 

which  couples  the  eigenvalues  r  of  5^  with  the  eigenvalues  fi  ol  B  .  This  func¬ 
tional  equation  (d.5)  has  thus  the  flavor  of  Young’s  classical  result  [D.8]  of  1954  : 

(X  -I-  cj  -  1)^  =  X  o;^  , 

and  its  extension  by  Varga  [D.5]  in  1959  : 

(X  -1-  w-  1)P  =  XP-‘  cjP  , 

in  the  weakly  cyclic  of  index  p  case,  which  similarly  couples  the  eigenvalues  X  of 
the  SOR  operator  L  defined  by 

L,:=(I  -ujh)-'  [(l-w)!  +ul]  ]  ,  (d.6) 

with  the  eigenvalues  n  of  the  Jacobi  matrix  B  . 

To  describe  an  application  of  the  functional  equation  (d.5)  to  //-matrices, 
we  first  recall  some  important  concepts  due  to  Ostrowski  [D.4|  in  1937.  Any  real 
n  Xn  matrix  E  =  [c,-  y]  with  e,- y  <  0  for  all  i  ^  j ,  can  always  be  expressed 
as 

E  =  -c  , 

where  C=[c,- y]  is  an  nXn  matrix  having  only  nonnegative  entries.  If 
j;  >  p{C )  (where  p[C)  denotes  the  spectral  radius  of  C  ),  then  E  is  said  to  be  a 
nonsingular  M-matrix.  Next,  if  F  =  (/i,y]  is  any  nXn  complex  matrix,  then 
its  associated  real  n  Xn  comparison  matrix,  M [F  )  :=  [a;  j  j,  is  defined  by 

•=  I  fi,j  I  >  =  ■  I  fiJ  I  ’  *  ‘  >  J  <  ”  • 

Then,  F  is  said  to  be  a  nonsingular  //-matrix  if  its  comparison  matrix  M{F)  is 
a  nonsingular  M-matrix.  For  further  notatioh,  if  F  =  [/,_y|  is  any  nXn  com¬ 
plex  matrix,  then  [  F  j  denotes  the  real  nXn  matrix  [  ]  /,-  y  |  ]  . 

Consider  then  any  n  Xn  complex  matrix  A  =  [a,-,y]  having  nonzero  diago¬ 
nal  entries,  and  set 

D(A  )  :=  j  B  =  [6,  y]  :  j  6,  y  |  =  |  o,  j  |  for  all  1  <  i,  j  <  n  |  .(d.7) 

For  each  B  e  n(A  ),  we  can  express  B  as 

B  =  D(B)- LiB)-  U{B)  , 

where  D(B)  :=  diag  f,  62,2!  '  »  ^n,n  ]  is  nonsingular,  and  where  L{B) 
and  U  [B  )  are  resective  y  lower  and  upper  triangular  matrices.  Then 

7(B):=  (D(B))-'  {t(B)+ 
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defines  the  associated  Jacobi  matrix  for  each  B  €  n(A  )  . 
With  the  notation 


H,:=  {a  is  an  n  X  n  complex  matrix  ,  n  arbitrary  :  A  is  an  H-^A^ix 

/)  (  1  J(A  )  I  )  =  i/  I  ,  for  each  i/  e  (o  ,1)  > 


with 


it  wjis  shown  by  Alefeld  and  Varga  in  [D.l]  in  1976  that,  for  A  e  H  then  for 
any  B  e  n{A  ),  its  associated  SSOR  iteration  matrix  SJ(B )  (cf.  (d.4))  satisfies 


p  ( SJB )  )  <  1  for  any  0  <  w  <  , 


(d.9) 


i.e.,  for  each  B  in  rt{A  )  and  for  each  w  in  (0, 


ll+H 


■),  5  is  convergent . 


Now,  a  natural  question  is  if  the  interval  ((0,  in  u>  for  convergence  in 

(d.9)  is  sharp  for  the  class  H  of  //-matrices.  By  applying  the  functional  equa¬ 
tion  of  (d.5)  for  special  matrices  in  //(, ,  it  was  shown  in  Varga,  Niethammer,  and 

Cai  [D.7]  that,  for  each  v  with  —  <  <  1  , 

sup  I  p  (  5^^  (B)  )  :  B  €  //,y  I  >  1  (  divergence  )  (d.lO) 

for  any  w  satisfying 

Then,  subsequently  it  was  shown  in  Neumaier  and  Varga  [D.2]  (using  the  theory 
of  regular  splittings)  that  the  bound  of  (d.ll)  exactly  separates  the  convergence 
and  divergence  domains  for  matrices  in  H More  precisely,  if 


u  (i/)  :  = 


2,  if  0  <  j/  <  -  ; 

-  -  2 

- 1=  ,  if  4-  <  t'  <  1  , 

l+\/2i/-l  2 


(d.l2) 


then  (cf.  [D.2])  for  each  matrix  A  in  H ^  and  for  each  w  with  0  <  w  <  u;  (^), 

P  )  <  1  •  (d.l3) 


Finally,  we  give  brief  mention  to  the  fact  that  similar  techniques  are  applied 
in  Niethammer,  de  Pillis,  and  Varga  [D.3j  to  the  iterative  solution  of  sparse  least 


squares  problems.  A  survey  of  the  results  of  this  section  can  also  be  found  in 
ID.6]. 
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E.  Comparisons  of  regular  splittings  of  matrices. 

The  theory  of  regular  splittings  of  matrices,  introduced  in  1960  by  Varga 
[E.2],  has  been  a  useful  tool  in  the  analysis  of  iterative  methods  for  solving  large 
systems  of  equations.  For  our  theoretical  background,  let  A,  A/,  and  N  be  all 
n  X  n  complex  matrices.  Then,  A  =  M  -  N  is  a  regular  splitting  of  .A  if  M  is 
nonsingular  and  if  M  and  N  have  all  their  entries  nonnegative,  written 
M  -^  >  O  and  iV  >  O . 

Consider  the  solution  of  the  matrix  problem 

A  X  ,  (e.l) 

where  A  admits  a  regular  splitting  A  —  M  -  N .  Then,  (e.l)  becomes 

M  X  =  N  X  +  k  ,  (e.2) 

which  induces  the  iterative  method 

M  x(m)  +  i  ,  or  =  A/-*  V  xf*")  +  M-*  ,  m  =  0,l(-c:a) 

The  following  are  well-known: 


Theorem  A  ([E.2]).  Let  A  =  Af  -  V  be  a  regular  splitting  of  A  .  If 
A >  Of  then 

P[M-'N)=  <  1,  M) 

1  -I-  p  (A  'V) 

i.e.,  the  iterative  method  of  (e.3)  is  convergent  for  any  start  vector  ^ 
Conversely,  if  p  (M  A^)  <  1,  then  A"*  >  O . 


Theorem  B  ([E.2]).  Let  A  =  Mi  -  N i  =  M2  -  N2  be  two  regular 
splittings  of  A  ,  where  A”*  >  0  .  If  N2  >  A^i  (Le.,  N2  -  ATj  >  O  ),  then 

1>p(M2-‘  Af2)>p(M,-‘  Ni),  (e.5) 

i.e.,  the  iterative  method  (e.3)  associated  with  the  splitting  A  =  M  i  -  N i 
is  asymptotically  faster  than  that  associated  with  the  splitting 

A  =  M2  -  ^2* 

Less  well-known,  but  nevertheless  useful  in  applications,  is  the  following 
unpublished  thesis  result  of  1973  of  Z.  Woznicki  [E.3]: 


Theorem  C  ([E.3]).  Let  A  =  A/j  -  Nj  =  A/2  -  A^2  regular 

splittings  of  A  ,  where  A”*  >  0  .  If  A/|”^  >  A/2"* ,  then 

Ni)>p{M,-'  N,). 


(e.6) 
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Now,  with  the  hypotheses  of  Theorem  B  or  C,  it  is  shown  in  Csordas  and 
Varga  [E.l]  that 

»  )  ^2  ^  implies  A/j"*  >  M2~^ ; 

«  Mi~^  >  M2"*  implies  A~^  >  A~^  Ni  A~^; 

iii)  A~^  N2  A~^  >  A~^  N I  A~^  implies  (A~^  N^^-A~^  >  (^4"*  iV|)^  A"*  for 
each  positive  integer  j . 

Moreover,  the  reverse  implications  in  * ),  it ),  and  iii )  are  not  in  general 
valid.  Now,  the  weakest  hypothesis  of  the  above,  namely 
(A"*  ^2)^  ^  fof  some  positive  interger  j ,  gives  a  gen¬ 

eralization  of  Theorem  B  and  C. 

Theorem  1.  ([E.l]).  Let  A  =  M|  -  N 1  =  M2  -  be  two  regular 
splittings  of  A  ,  where  A  ~*  >  O ,  Assume  there  exists  a  positive  integer 
;  for  which  (A"*  ^2)^'  A"*  >  (A"*  A"*.  Then, 

1  >  p  (M,->  AT,)  >  p  (A/j-’  Wj)  .  (e.7) 

A  final  result  of  Csordas  and  Varga  |E.l]  gives  partial  converses  to  Theorems 
B  and  C,  and  unifies  the  earlier  results  of  Varga  and  Woznicki. 


Theorem  2  ([E.l]).  Let  A  =  Mi  -  Ni  =  M2  -  N2  be  two  regular 
splittings  of  A  ,  where  it  is  assumed  that  A  "*  >  O .  If 

p(M,-'  Ni]>  p(M,-'  N,),  (e.8) 

there  exists  a  positive  integer  j  q  for  which  (  cf.  iii )  ) 

(A-*  ^2)^'  A-*  >  (A-*  Ni)}  A"*  for  all  j  >  jo  .  (e.9) 

Conversely,  if  there  is  a  positive  integer  j  for  which 

(A-*  ^2)^'  A"*  >  (A-*  NiY  A"*  ,  (e.lO) 

then  (e.8)  is  valid. 
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